Methods and Apparatus for Converting an Orthogonal Pixel Format to a 

Diamond Pixel Format 

[0001] This application claims the benefit of U.S. Provisional Application No. 60/474,640, 
filed on May 30, 2003, entitled "Spatial Light Modulator with Diamond Pixels," which 
application is hereby incorporated herein by reference. 

TECHNICAL FIELD 

[0002] The present invention relates generally to a system and method for displaying digital 
data, and more particularly to a system and method for converting a standard orthogonal digital 
pixel format suitable for display on an orthogonal-shaped pixel array to a diamond-shaped pixel 
format for display on a diamond-shaped pixel array. 

BACKGROUND 

[0003] Referring to FIG. 1, an example of a DMD™ (digital micro-mirror device) system 
20 is illustrated, wherein the light from a light source 22 is applied through a first lens 24 and 
through a color wheel 26, which will typically rotate no less than about 60 revolutions or 60 
frames per second. Alternately, the color wheel 26 may make up to five or six revolutions per 
frame or about 300-350 revolutions per second. The light passing through the color wheel 26 
passes through a second lens 28 onto a DMD™ array or chip 30. The DMD™ chip includes an 
array (on the order of one million) of tiny mirror elements, or micro-mirrors, where each mirror 
element is hinged by a torsion hinge and support post above a memory cell of a CMOS static 
RAM as shown in FIG. 2 and FIG. 3. 

[0004] FIGs. 2 and 3 show a portion of a typical DMD™ array 30 having mirror elements 

32 suspended over a substrate 34. Electrostatic attraction between the mirror 32 and an address 
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electrode 36 causes the mirror to twist or pivot, in either of two directions, about an axis formed 
by a pair of torsion beam hinges 38a and 38b. Typically, the mirror rotates about these hinges 
until the rotation is mechanically stopped. The movable micro-mirror tilts into the on or off 
states by electrostatic forces depending on the data written to the cell. The tilt of the mirror is on 
the order of plus 10 degrees (on) or minus 10 degrees (off) to modulate the light that is incident 
on the surface. For additional details, see U.S. Pat. No. 5,061,049 entitled "Spatial Light 
Modulator" and U.S. Pat. No. 5,280,277 entitled "Field Updated Deferrable Mirror Device," both 
by Larry J. Hombeck. 

[0005] Referring again to FIG. 1, the light reflected from all, selected ones, or none of the 
mirrors may pass through a projection lens 40 and create images on the screen 42. The DMD™s 
are controlled by electronic circuitry fabricated on the silicon substrate 34 under the DMD™ 
array. The circuitry includes an array of memory cells, typically one memory cell for each 
DMD™ element, connected to the address electrodes 36. The output of a memory cell is 
connected to one of the two address electrodes and the inverted output of a memory cell is 
connected to the other address electrode. Data is provided by a timing and control circuit 44 
determined from signal processing circuitry and an image source indicated at 46. Once data is 
written to each memory cell in the array, a voltage is applied to the DMD™ mirrors 32 creating a 
large enough voltage differential between the mirrors 32 and the address electrodes 36 to cause 
the mirror to rotate or tilt in the direction of the greatest voltage potential. Since the electrostatic 
attraction grows stronger as the mirror is rotated near an address electrode, the memory cell 
contents may be changed without altering the position of the mirrors once the mirrors are fully 
rotated. Thus, the memory cells may be loaded with new data while the array is displaying 
previous data. 
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[0006] DMD arrays are typically operated in a dark-field mode. In one embodiment of 
dark-field operation shown in FIG. 4, light 22a from light source 22 is focused on DMD™ array 
30 and strikes the individual mirrors of the array 30 at an angle. According to the example 
shown in FIG. 4, when tilted or rotated to an ON position as indicated by mirror 32a, light 22a 
incident the mirror 32a will be reflected and focused onto an image plane or viewing screen 42 
where it will form part of the image. If a mirror 32b is rotated away from the light source to an 
OFF position, light 22a incident the mirror 32b will reflect away from the viewing screen 42 and 
will not form part of the image. 

[0007] Light incident on and reflected from a DMD™ mirror forms an illuminated dot on 
the viewing screen 42 for every mirror 32 that is rotated to the "ON" position. Each of these dots 
represents one picture element, or pixel, which is the smallest individually controllable portion of 
an image. Using a large array of these tiny mirrors, an image is created by selectively turning 
some mirrors to the "ON" position while turning some to the "OFF' position, thereby creating a 
pattern of illuminated dots on the viewing screen. 

[0008] A major production cost of DMD™ modules or mirror arrays for use as display drive 
engines is the silicon wafer and corresponding processing costs. Of course, if the number of 
modules that could be manufactured from a single wafer could be substantially increased, this 
increase would have a direct affect on the cost of the modules. A diamond-shaped array having 
the same number of rows and columns of pixels is only half the size of an orthogonal array and 
uses only half the number of pixels. Comparing the 8 colunm by 6 row orthogonal array of FIG. 
5 A with the 8 colunm by 6. row diamond-shaped array of FIG. 5B illustrates that even though the 
size of the pixels are the same, the diamond-shaped array is only about one half the size of the 
orthogonal pixel array. The difference in the overall size and total number of pixels of an 8X6 
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orthogonal array and an 8X6 diamond array is due to the difference in distance between adjacent 
horizontal and vertical pixels. For example, for an orthogonal array, and as shown in FIG. 5 A, 
the distance between adjacent rows, as indicated by double-headed arrow 50, is the same or 
equal to the distance between adjacent columns, as indicated by double-headed arrow 52. 
However, as shown in the diamond array of FIG. 5B, the distance between adjacent rows, as 
indicated by double-headed arrow 54, is only half that between adjacent columns, as indicated by 
double-headed arrows 56a and 56b. This is, of course, because there are actually two sets of 
columns. Namely, a first set for odd rows as indicated by reference number 58 and a second set 
of even rows as indicated by 60. 

[0009] Therefore, to maintain a particular or selected aspect ratio, the number of colunms in 
a diamond array will be one half that of its orthogonal counterpart. Thus, it will be appreciated 
that if the "orthogonal" digital data format that is typically used with digital displays could be 
used with a diamond-shaped array, a fifty percent reduction in size would be appreciated. The 
fifty percent reduction in size would translate to substantially double the number of dies per 
wafer. Consequently, yield per wafer could be significantly improved by using a diamond array. 

[0010] It should also be appreciated that the present invention is discussed with respect to 
reducing the size of the mirror array so as to increase yield. Altemately, however, the number of 
pixels and, consequently a diamond array used to replace an orthogonal array could remain the 
same size as an orthogonal array. In this event, rather than an increase in yield, the resolution 
would be increased. However, as will also be understood from the discussion below, although 
doubling the number of pixels will increase the resolution, it will not double the resolution. 

[0011] Conversely, loss in resolution will occur with the conversion from an orthogonal to a 
diamond array. For example, the bandwidth of the Horizontal and Vertical frequency of a 
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diamond array is illustrated in FIG. 6. As shown, FIG. 6 is a plot of a 128-point two-dimensional 
fast Fourier transform (FFT) used to determine the frequency response where "0" corresponds to 
the frequency minus ti, and 128 corresponds to the frequency plus tt. The frequency plot 
indicated by the raised area 62 illustrates how the diamond array maintains the highest 
Horizontal and Vertical frequencies as illustrated by solid arrows 64a and 64b respectively, but 
only half the bandwidth of the highest Diagonal frequency as indicated by dashed arrows 66a 
and 66b. That is, the Horizontal and Vertical frequencies indicated at coordinates 68 and 70, 
respectively, include the fiill range of frequencies as indicated by arrows 64a and 64b, whereas 
the Diagonal values indicated by dashed arrow 66a is only half that of the Diagonal frequency 
for an orthogonal array as indicated by arrow 72. 

[0012] This change in bandwidth is further illustrated in the display of FIGs. 7 A through 9 A 
and FIGs. 7B through 9B showing how the diamond array image was created by sub-sampling 
the orthogonal array. This sub-sampling was accomplished by removing the even pixels from 
the orthogonal array for odd rows in a diamond array and removing the odd pixels from the 
orthogonal array for the even rows in the diamond array. For example, FIG. 7 A illustrates how 
vertical lines 74, 76, 78 and 80 of pixels of four different colors shown in an orthogonal array 
can be reproduced as lines 74a, 76a, 78a and 80a in the diamond array of FIG. 7B. Likewise, 
FIG. 8A illustrates that horizontal lines 82, 84 and 86 of different colors in the orthogonal array 
can be reproduced as lines 82a, 84a and 86a of FIG. 8B. However, since converting from an 
orthogonal array to a diamond array by this type of sub-sampling results in every other pixel on 
each line being removed, the diagonal lines 88, 90, 92, 94, 96 and 98 of the orthogonal array of 
FIG. 9A cannot be reproduced by the diamond array of FIG. 9B. The inability to produce the 
diagonal rows by this simple sub-sampling method is a result of the distortion caused by the 
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interaction between the signal frequency and the sampling frequency hereinafter referred to as 
aliasing. The spaces in the angled letter "V" in the city names "Vancouver" and "Victoria" of 
FIGs. lOA and lOB illustrates the results of aliasing. More specifically, or as is better illustrated 
in the enlarged view of FIG. lOB, the result of removing the pixels in the conversion is obvious. 
FIG. IOC shows the visual improvement when the aliasing is removed. 

[0013] Therefore, methods and apparatus for using a diamond-shaped array without 
unacceptable loss of resolution and increased artifacts would clearly be advantageous. 
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SUMMARY OF THE INVENTION 

i 

[0014] These and other problems are generally solved or circumvented, and technical 
advantages are generally achieved, by embodiments of the present invention which provides 
apparatus and methods for converting digital data signals representing an image suitable for 
display with an orthogonal pixel array such that the converted digital data is suitable for 
displaying the image on a diamond-shaped pixel array. 

[0015] According to one embodiment of the invention, the methods and apparatus 
comprises receiving a stream of digital data signals representing an image to be displayed on an 
orthogonal pixel array. The data stream is provided to an IIR (Infinite Impulse Response) filter 
for conditioning the received digital data stream such that it can be sub-sampled and used on a 
diamond-shaped pixel array with minimal distortion caused by aliasing. The filtered data stream 
is then sub-sampled for use on a diamond-shaped pixel array by dropping data that controls even 
pixels on all odd numbered orthogonal rows and also dropping data that controls odd pixels on 
all even numbered rows. 

[0016] According to another embodiment of the invention, die IIR filter includes a plurality 
of stages and an output tap connection at the output of one of the plurality of stages for providing 
a partially filtered output data stream to Ringing Minimization circuitry. The Ringing 
Minimization circuitry uses this partially conditioned data stream to provide a Ringing 
Minimization signal. The ringing minimization signal is then combined with the filtered data 
stream to generate a version of the filtered data stream that results in reduced "ringing" of the 
image when displayed. 
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[0017] According to a further embodiment, the filtered data stream is received at circuitry 
that detects the presence of vertical edges in the image and is then provided to switching circuitry 
that selectively connects the filtered sub-sample data stream to a first high frequency filter when 
a vertical edge is detected and to a second high frequency filter when a vertical edge is not 
detected. The two high frequency filters emphasize a vertical or horizontal edge. For example, 
the sub-sampled filtered data is applied across three line-interleaved pixels when the first high 
frequency filter is selected (emphasizes a vertical edge) and is applied across three horizontally 
adjacent pixels when the second high frequency filter is selected (emphasizes horizontal edges). 

[0018] The foregoing has outlined rather broadly the features and technical advantages of 
the present invention in order that the detailed description of the invention that follows may be 
better understood. Additional features and advantages of the invention will be described 
hereinafter which form the subject of the claims of the invention. It should be appreciated by 
those skilled in the art that the conception and specific embodiment disclosed may be readily 
utilized as a basis for modifying or designing other structures or processes for carrying out the 
same purposes of the present invention. It should also be realized by those skilled in the art that 
such equivalent constructions do not depart from the spirit and scope of the invention as set forth 
in the appended claims. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0019] For a more complete understanding of the present invention, and the advantages 
thereof, reference is now made to the following descriptions taken in conjunction with the 
accompanying drawing, in which: 

[0020] FIG. 1 is an overall schematic of a prior art Digital Micro-mirror Display System that 
can benefit from the teachings of this invention; 

[0021] FIG. 2 is a perspective view of a portion of a Digital Micro-mirror Device (DMD™) 
array of the prior art; 

[0022] FIG. 3 is an exploded view of the DMD™ of FIG. 2; 

[0023] FIG. 4 is a schematic representation of the bi-stable operation of two mirrors of the 
DMD™ array of FIG. 2; 

[0024] FIGs. 5 A and 5B illustrate the reduction in physical size of a display array by using a 
diamond-shaped array rather than an orthogonal array; 

[0025] FIG. 6 is a presentation of the Horizontal and Vertical frequency responses of a 
diamond array as determined by FFT (Fast Fourier Transform) compared to an orthogonal array; 

[0026] FIGs. 7 A, 7B, 8 A, 8B, 9 A and 9B illustrate the results of reproducing vertical, 
horizontal and diagonal lines presented on an orthogonal array when converted to a diamond 
array by conventional sub-sampling of the orthogonal pixels; 

[0027] FIGs. IDA and lOB are pictorial representations of the aliasing or artifacts that occur 
when generating diagonal line images on a diamond-shaped array; 
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[0028] FIG. IOC illustrates how the image appears when corrected for aliasing of the type 
shown in FIGs. IDA and lOB; 

[0029] FIGs. 1 1 A and 1 IB are similar to FIGs. 5A and 5B and show the data stream order 
for an orthogonal array; 

[0030] FIG. 1 IC shows sub-sampled data for a diamond array interleaved with data rows to 
allow use of existing format circuitry; 

[0031] FIG. 12 is a block diagram of circuitry of the present invention for converting a 
digital data stream generated for being displayed on an orthogonal array to a suitable format for 
displaying on a diamond array; 

[0032] FIG. 13 is a detailed block diagram of the "Linear Phase DR Filter" and "Ringing 
Minimization" circuitry of FIG. 12; 

[0033] FIGs. 14A and 14B are block diagrams illustrating a one PORT RAM and vertical 
edge detection circuitry as taught by the present invention; 

[0034] FIGs. 15 A and 15B illustrate the operation of the vertical edge detection circuitry of 
FIG. 14B for "even" and "odd" orthogonal pixels respectively; 

[0035] FIGs. 16A and 16B illustrate the pixel arrangement that is provided to a vertical 
high-pass filter and a horizontal high-pass filter respectively; 

[0036] FIGs. 17A and 17B are graphs showing frequency response of the vertical and 
horizontal high-pass filters; and 

[0037] FIG. 18 is a block diagram illustrating the high-pass filters and the available gain 
adjustment. 
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DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS 

[0038] The making and using of the presently preferred embodiments are discussed in detail 
below. It should be appreciated, however, that the present invention provides many applicable 
inventive concepts that can be embodied in a wide variety of specific contexts. The specific 
embodiments discussed are merely illustrative of specific ways to make and use the invention, 
and do not limit the scope of the invention. 

[0039] As was discussed above with respect to FIGs. 5A and 5B, sub-sampling the original 
orthogonal pixel data to convert to a diamond format introduces aliasing. This artifact is a result 
of removing half of the pixels from the orthogonal image and moving the relative position of 
these remaining pixels. 

[0040] For example, referring now to FIGs. 1 1 A, 1 IB and 1 IC, there is illustrated the sub- 
sampling of the orthogonal pixel array data to obtain the pixel data for use with a diamond- 
shaped array. FIGs. 1 lA and 1 IB are similar to FIGs. 5 A and 5B discussed above, and 
therefore, common elements carry common reference numbers. In the 8X6 orthogonal 
illustration of FIG. 11 A, the first 8 sets of data numbered 0-7 are provided for the first 
orthogonal row. In a similar manner, data sets numbered 8-15, 16-23, 24-31, etc., are provided 
for orthogonal rows 2 through 6. However, referring to FIG. 5B, it is seen that the pixel with 
data set 2 is now adjacent to the pixels holding data sets 0 and 4 rather than the pixels holding 
data sets 1 and 3, which have been removed by sub-sampling. Likewise, considering the vertical 
arrangement, the pixel holding data set 25 is now- adjacent to the vertical pixels holding data sets 
9 and 41 rather than the pixels holding data sets 17 and 33. Therefore, it should be appreciated 
that adjusting or conditioning of the pixels used in the diamond array to compensate for the 
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dropped pixels will help eliminate errors or artifacts. This type of conditioning to remove 
aliasing has typically been achieved by the use of a low-pass filter, and more specifically, by the 
use of an FIR (Finite Impulse Response) filter. In the past, FIR filters were typically selected for 
such sample rate conversion problems over DDR (Infinite Impulse Response) filters, because FIR 
filters are inherently linear-phase while the prior art DR filters resulted in phase distortion 
problems. 

[0041] The present invention, however, uses a unique Linear Phase IIR (Infinite Impulse 
Response) Filter to adjust or condition each pixel prior to the sub-sampling that avoids the 
problems of the prior art lER filters. 

[0042] Referring now to FIG. 12, there is shown a block diagram of circuitry for converting 
a stream of digital data suitable for display on an orthogonal pixel array, such as shown in FIG. 
1 lA, to a format for display on a diamond-shaped pixel array, such as shown in FIG. 1 IB. 
Although only one input In(x,y) is shown and discussed with respect to a color display, it will be 
appreciated that there can be a circuit similar to that shown in FIGs. 12 and 13 for each of the 
primary color signals of a display data stream. As will also be appreciated for most applications 
and signal sources for color displays whether digital TV or movies, etc., there will be three 
primary color signals of red, green and blue and, consequently, three circuits, similar to FIG. 12 
and FIG. 13. Therefore, as shown in FIG. 12, a stream of input digital data is provided to the 
Linear Phase IIR Filter circuit 142 on line 144. After passing through the HR Filter, the 
modified data stream is provided to Ringing Minimization circuitry 146 shown in the same block 
as DR Filter circuitry 142, but separated by a dotted line. Although the Ringing Minimization 
circuitry 146 is not actually part of the IIR Filter circuitry 142, it is illustrated as part of the same 
circuit block because it requires inputs corresponding to intermediate results already calculated 
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by the HR Filter circuitry 142. The filtered input with Ringing Minimization is then provided as 
an output from the Ringing Minimization circuitry 146 on line 148 which in turn is provided to 
the Sub-Sampling with Vertical Edge Detection circuitry 150 referred to hereinafter as the "Sub- 
Sampling circuitry." Sub-Sampling circuitry 150 will be discussed in greater detail below, but 
basically comprises a first high-pass filter that is applied across three line-interleaved pixels that 
emphasize vertical edges without requiring an additional line of memory if a vertical edge is 
detected. On the other hand, if a vertical edge is not detected, a high-pass filter is applied only 
across three horizontally adjacent pixels. Thus, as shown, Sub-Sampling circuitry 150 provides 
an output signal S (x, y) for each pixel on line 152. A second signal D (x, y), indicating whether 
or not a vertical edge is detected, is provided with the pixel signal as indicated on line 154. 
These outputs on lines 152 and 154 from Sub-Sampling circuitry 150 are provided as inputs to 
the "High-Frequency Emphasis Filter" 156 which then filters the data on line 152 with the 
correct high-pass filter, a vertical high-pass filter when line 154 is equal to one and a horizontal 
high-pass filter when line 154 is equal to zero. The results of the selected high-pass filter are 
gained and added into the non-filtered data streani, line 152, and form the output data stream, 
line 158. 

[0043] As shown in FIG. 13, the In(x,y) signal is received on line 144 and is provided to 
sub-circuits of the HR circuitry 142 and Ringing Minimization circuitry 146. The Ringing 
Minimization circuitry 146 will be discussed later. The In(x,y) signal is provided to an "Add" 
sub-circuit 160 and a Delay sub-circuit 162 in the HR Filter. From the figures, it is seen that the 
In(x,y) circuitry is added to another signal arriving on line 164 also received at "Add" circuit 160 
to generate a combined signal at node Ni. The generated signal received at node Ni is provided 
to a Delay sub-circuit 166, a Right Shift By 2 circuit 168 and a Right Shift By 3 circuit 170. 

TI.3S626 -13- 



Referring again to FIGs. 1 1 A and 1 IB, there is shown a pixel 18 in the orthogonal array of FIG. 
1 1 A, which will have a data set arriving on line 144 of the filter circuit of FIG. 13 as In(x,y) 
where In represents the binary data that determines the signal intensity. The (x,y) identifies the 
row(x) and colunin(y) of the pixel that is to be adjusted or conditioned by the circuitry of FIG. 
13. In the example of FIG. 1 lA, x=3 and y=3 for pixel 18. 

[0044] Thus, the signal for each pixel is received at node Ni by Delay circuitry 166 is 
delayed for a fiill line (or row of pixels) plus one pixel when referenced to the orthogonal pixel 
represented by the present In(x,y) signal. However, it will also be appreciated that in the 
example, data for pixel 18 is combined with a negative portion (0.375) of the data for pixel 9 that 
was previously delayed by one row plus one pixel. More specifically, a negative portion of the 
signal In(2,2) for pixel 9 is combined with the signal In(3,3) for pixel 18 by "Add" circuit 160 to 
generate the signal at node Ni. It will also be appreciated that the full negative value of 0.375 
Ni(2,2) is not combined with In(3,3) since the In(2,2) value has itself been adjusted in a similar 
manner before being combined. Thus, the delayed signal from delay circuit 166 is also provided 
to another "Add" circuit 172, which will be discussed later, as well as to a "Right Shift By 2" 
174 and a "Right Shift By 3" circuit 176. These two shifted values are then combined at "Add" 
circuit 178 before being inverted (i.e., sign change) by inverter circuitry 180. The output of 
inverter circuitry 180 is the signal on line 164 provided to "Add" circuit 160 described above. 
Thus, the signal at node Ni is comprised of the In(x,y) signal on line 144 which is combined by 
"Add" circuit 160 with the signal on line 164. Therefore, a signal at Nj can be determined and 
represented by the equation 1 below. 

Equation 1. 

N, (x, y) = /„ (x, y) - 0.375 AT^ {x + 1, y - 1) 
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[0045] More specifically, the term "In(x,y)" in equation 1 is, of course, the original input 
signal. The "Ni(x+l,y-l)" portion of the equation is the value of the signal at node Ni for a pixel 
delayed by one line or row (y-1) and one pixel (x+1). The 0.375 represents the combined output 
from "Add" circuit 178. The components of the "Add" circuit 178 include a pixel shift of two 
positions to the right. In a digital binary system, this is, of course, the same as dividing by four 
and is provided by shift circuitry 174. Thus, 1/4=0.25. Similarly, the output of shift circuit 176 
results in a right shift of three, which in a digital binary system, is the same as dividing by eight. 
Thus, 1/8=0.125. Combining 0.25 and 0.125 results in 0.375 (0.125+0.25=0.375). Finally, 
inverter circuitry 180 changes the positive value of 0.375 to a negative value of 0.375 to yield the 
"-0.375Ni(x+l,y-l)" input portion of the "Add" circuit 160. The value at node N2 is determined 
in a similar manner. For example, as discussed above, the Ni node value is provided to "Right 
Shift By 2" circuitry 168 and "Right Shift By 3" circuitry 170. The output of these "Right Shift" 
circuits are the saraie as a divide by eight and a divide by four circuit, as was discussed above. 
Thus, we again have the value of 0.25+0.125=0.375 provided to an "Add" circuit 182 to arrive at 
0.375Ni(x,y). This value is combined with the output Ni(x+l,y-l) from Delay circuit 166 as 
discussed above by "Add" circuit 172. Therefore, the signal value at node N2 may be expressed 
by equation 2. 

Equation 2. 

N^{x,y)=N,{x + hy-l)+0.315N,{x,y) 

[0046] The value of node N3 is expressed in equation 3 below and is also determined in a 
similar manner. 
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Equation 3. 

N,{x,y) = N,{x,yh0.315N,{x-ly-l) 

[0047] As can be seen, the signal value of N3 is the signal value at node N2 (i.e., N2(x,y)) 
combined with the value on line 184 by "Add" circuit 186. The signal value on line 184 is 
determined by Delay circuit 188, "Right Shift By 2" circuit 190, "Right Shift By 3" circuit 192 
"Add" circuit 194 and Invert circuit 196 in exactly the same way as the signal generated on line 
164 provided to "Add" circuit 160 discussed above. The only difference is that Delay circuit 
188, delays the signal one row or line "less" one pixel (i.e., data for pixel 1 1) rather than one row 
or line "plus" one pixel (i.e., data for pixel 9). 

[0048] The signal value at node N4 is determined in exactly the same manner as the value at 
N2 by the "Right Shift By 2" circuit 198, "Right Shift By 3" circuit 200 and "Add" circuit 202 
and 204. 

Equation 4. 

N,{x,y)= N,{x-ly-l)'^0315N,{x,y) 

[0049] The final result or output of the IIR Filter 142 indicated at N5 is the value of N4 
combined by "Add" circuit 206 with a one line delay provided by "Delay" circuitry 162 
mentioned above. The equation for the N5 node is: 

Equation 5. 

N,{x.y)^N,{x.y) + lSx,y-l) 
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[0050] With respect to FIGs. 5A and 5B, sub-sampling of the original orthogonal data was 
accomplished by simply dropping all of the odd numbers of pixels for the even rows and 
dropping all of the even number of pixels for the odd rows. This is also shown in FIGs. 1 1 A and 
1 IB. However, as was also discussed, this approach created some unacceptable artifacts, and to 
eliminate the unacceptable artifacts, the data is passed through the IIR Linear-Phase Filter as was 
just discussed. However, to minimize the amount of DMD™ formatter changes needed to 
accommodate the diamond array, the process of this invention also interleaves the diamond rows. 
This can be accomplished by providing the filtered data on line 208 to the single port 210 of 
RAM 212 as shown in FIG. 14A prior to the detection of a vertical edge illustrated generally by 
circuitry 214 of FIG. 14B. RAM 212 only needs to be written to for even orthogonal rows and 
read from for odd orthogonal rows. That is, only data for the even orthogonal lines are stored, 
and line interlaced diamond rows are only produced for even orthogonal lines as indicated in 
FIG. lie. Thus, as is also shown in FIG. IIC, odd data sets, i.e., 9, 11, 13 and ISofFIG. IIA, 
from the even orthogonal lines are interlaced with the even data sets, i.e., 0, 2, 4 and 6, of the 
previous odd lines. 

[0051] As was mentioned above. Ringing Minimization circuitry 146 requires some of the 
same data already processed by the Linear Phase IIR Filter and, therefore, is illustrated in the 
same block 142 of the block diagram of FIG. 12. The required data can be tapped from the IIR 
Filter and used by the Ringing Minimization circuitry 146. As shown in FIG. 13, the pixel data 
received on line 144 is also provided to "minimum" circuitry 216 and "maximum" circuitry 218. 
In addition, the output of delay circuit 162 is also provided as an input to both minimum circuit 
216 and maximum circuit 218. The output of circuits 216 and 218 are respectively provided to 
circuits 220 and 222, which in turn provide outputs to limiter circuit 224. 

TI.35626 -17- 



[0052] As was briefly discussed above, a high-frequency emphasis filter 156 switches 
between two filters based on whether an "edge" is primarily a vertical edge or a horizontal edge. 

[0053] To detect vertical edges, absolute differences between vertically adjacent pixels are 
calculated from the orthogonal data array before the "even" lines are decimated, i.e., pixels are 
dropped. If the calculated absolute differences are above a user-defined threshold, then a vertical 
edge has been detected and the data flow is switched to the vertical high-pass filter. For all other 
cases, the horizontal high-pass filter is used. 

[0054] FIG. 15A, along with the orthogonal data array of FIG. 1 1 A, illustrates the edge 
detection for "even" orthogonal pixels. As shown in FIG. 15 A, the specific pixel under 
investigation in this example is pixel 26 from the array of FIG. 1 lA. Generically, this pixel 26 is 
identified by its location as (x, y). Then, as indicated by double-headed arrow 226 in FIG. 15 A, 
the "absolute" difference AVi7,25 between pixels 17 and 25 is calculated. Referring again to 
FIG. 1 lA and as also shown in FIG. 15 A, it is seen that the generic location of pixel 17 is (x-1, 
y-1) and the generic location of pixel 25 is (x-1, y). In the same manner, the absolute difference 
AVi9,27 between pixels 19 and 27 is calculated as indicated by double-headed arrow 228. The 
generic location of pixel 19 is (x+1, y-1) and the generic location of pixel 27 is (x+1, y). 

[0055] From the above discussion, it will also be appreciated that the values of pixels 17 and 
19 from an "odd" orthogonal line is stored in RAM. Further, pixels 25 and 27 from an "even" 
orthogonal line will be dropped (or decimated). The AV (absolute value) calculations may be 
express mathematically as: 

Equation 6. 

AV,,,^=|(U-l,y-l)-(x-l,y)J 
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[0056] Therefore, if the value AVi7,25 of equation 6 is greater than the user-defined Edge 
Threshold (ET) value, and the AY 19,21 of equation 7 is greater than the ET value, then a vertical 
edge has been detected and the vertical high-pass filter is applied across three line-interleaved 
pixels. Otherwise, the system considers that a vertical edge has not been detected and a 
horizontal high-pass filter is used. 

[0057] FIG. 15B, on the other hand, illustrates edge detection for "odd" orthogonal pixels. 
As shown, the pixel under investigation in this example is pixel 27 as illustrated in FIG. 1 1 A. In 
this example, as indicated by double-headed arrow 230, the absolute difference between pixels 
25 (x-2, y) and pixel 33 (x-2, y+1) is determined, as is the AV27,35 between the pixel under 
investigation 27 (generic location (x, y)) and pixel 35 (x, y+1) illustrated by double-headed 
arrow 232, and the absolute value difference of pixel 29 (x+2, y) and 37 (x+2, y+1) as indicated 
by double-headed arrow 234. Therefore, expressing these calculations mathematically, the 
equations are: 



Equation 8. 



(x-2,>; + l)J 



Equation 9. 



Equation 10. 



{x + 2,y + ij\ 
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[0058] Then, if all three absolute values are greater than the user-defined ET value, the 
high-pass filter is applied across three line-interleaved pixels. Otherwise, the horizontal high- 
pass filter is applied across three horizontally adjacent pixels. 

[0059] FIG. 16A illustrates the tap position and coefficients for the vertical high-pass filter 
applied to three line-interleaved pixels, and FIG. 16B illustrates the tap and coefficients 
examples for the horizontal high-pass filter applied to three horizontally adjacent pixels. 

[0060] The results of the selected high-pass filter (vertical or horizontal) are then added into 
the data stream. The inherent gain of the two high-pass filters is four (4) as illustrated in FIGs. 
17A and 17B. However, the gain is altered based on the local variance of the sub-sampled data, 
and the local variance is estimated by taking the difference between the maximum and minimum 
values within the span of the filter. Thus, according to one embodiment, three user-defined 
thresholds define four groups or bins, and applying a particular user-defined gain depends on 
which bin or group the data falls in. Thus, high-frequency, low-level noise can be removed by 
setting the gain of the lowest group to a negative value such as, for example, -1/4, whereas edge 
enhancement is realized by setting the other variance groups or bins to positive value gains. This 
process is illustrated in FIG. 18, which shows the high-pass filter and the gain adjustments. 

[0061] Although the present invention and its advantages have been described in detail, it 
should be understood that various changes, substitutions and alterations can be made herein 
without departing from the spirit and scope of the invention as defined by the appended claims. 

[0062] Moreover, the scope of the present application is not intended to be limited to the 

particular embodiments of the process, machine, manufacture, composition of matter, means, 

methods and steps described in the specification. As one of ordinary skill in the art will readily 

appreciate from the disclosure of the present invention, processes, machines, manufacture, 
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compositions of matter, means, methods, or steps, presently existing or later to be developed, 
that perform substantially the same function or achieve substantially the same result as the 
corresponding embodiments described herein may be utilized according to the present invention. 
Accordingly, the appended claims are intended to include within their scope such processes, 
machines, manufacture, compositions of matter, means, methods, or steps. 
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